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Quantum phase transitions in the Kitaev—Heisenberg model on a single hexagon 
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We present a detailed analysis of the Kitaev-Heisenberg model on a single hexagon. The energy 
spectra and spin-spin correlations obtained using exact diagonalisation indicate quantum phase 
transitions between antiferromagnetic and anisotropic spin correlations when the Kitaev interactions 
increase. In cluster mean-field approach frustrated nearest neighbor exchange stabilizes the stripe 
phase in between the Neel phase and frustrated one which evolves towards the Kitaev spin liquid. 
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Possible realizations of quantum spin liquids is one of 
the most intriguing questions in modern theory of frus¬ 
trated spin systems [lH3j . One of the prominent examples 
of spin liquid was introduced by Kitaev jdj. As a unique 
feature of this exactly solvable model spin-spin corre¬ 
lations are finite only on nearest neighbor (NN) bonds 
Q. Recently a lot of attention is devoted to frustrated 
spin models on the honeycomb lattice, either to J1-J2 
Heisenberg interactions @, [T], or to Kitaev-Heisenberg 
(KH) model (sHIU- The latter is motivated by A 2 Ir03 
iridates (A=Na,Li) which is a candidate to host Kitaev 
model physics. For a realistic description of these com¬ 
pounds, and in particular of the observed zigzag phase 
|13| . also next nearest neighbor (NNN) and third nearest 
neighbor (3NN) Heisenberg antiferromagnetic (AF) in¬ 
teractions frustrating the Neel state are necessary [6], |l0( 
— these terms are also justified by rather itinerant char¬ 
acter of the electrons in A 2 IrC>3 14]. Several experiments 
suggest that the NNN (J 2 ) and 3NN (J3) coupling con¬ 
stants have similar values, i.e., J 2 ~ Ji/2, J 3 ss J 2 0- 

The purpose of this paper is to investigate the evolu¬ 
tion of spin-spin correlations on a single hexagon when 
interactions change from AF Heisenberg to highly frus¬ 
trated ferromagnetic (FM) Kitaev ones. This evolution 
is modified when a cluster mean-field (MF) approach is 
applied, similar to the one used before for the J 1 -J 2 -J 3 
model [6| and Kugel-Khomskii model 15| . 

The KH Hamiltonian has the form 1101, 


H = -2 Ja J2 S]S] + J(1 - a){ £ S, ■ S 0 
{ij)\h («') 

+ J 2 YI ^-Sj + Js J2 £•£, }. 

am am)) 


(i) 


In the first Kitaev term, bond-dependent Ising-like in¬ 
teractions are selected by 7 £ {x, y, z} depending on the 
bond direction. The parameter a interpolates between 
Heisenberg (a = 0) and Kitaev (a = 1) interactions. We 
set the energy unit J = 1, and we take equal NNN (J 2 ) 
and 3NN (J 3 ) interactions, i.e., J 2 = J3 = Ji/2 and 


Ji = (1 — a)J. Following the ab initio calculations 14j, 
we select the AF NN Heisenberg terms and FM Kitaev 
ones. Note that already at small a > 0 spin interac¬ 
tions are anisotropic, and classically Neel or resonating 
valence bond (RVB) phase is destroyed at a = 1/3 when 
some NN interactions switch from AF to FM. Here we 
investigate the more challenging quantum case. 

We performed exact diagonalisation (at T = 0) and 
investigated the energy spectra and spin correlations be¬ 
tween NN, NNN, and 3NN spins at sites {*,/}, 


S(i,j) = 0i ■ S,) = ±£>* 1 $ ' ( 2 ) 

u fc=1 

where {|} are individual degenerate states in the 
ground state manifold, and k = 1,... ,d. In addition, 
we investigate below partial spin correlations which re¬ 
flect the anisotropic character of spin interactions, 

= (SIS]) = ±J2($ k \S7S]\$ k ). (3) 

a k=1 

For a free hexagon, no order may occur and (5f) = 0. 

In the quest of quantum phase transitions (QPTs) sev¬ 
eral trails have been revealed. First clue appears to be 
change of the ground state of the Hamiltonian operator 
which defines the QPT. Second track signalling directly 
the transition is the variation of spin-spin correlations — 
either the change of sign, or discontinuities which are fin¬ 
gerprints of QPTs. Finally, extremal values of the ground 
state energy Eq might also indicate a transition [9|. 

Spin-spin correlations change in a discontinuous way 
at some values of a which indicate QPTs. Here we 
show only the correlations for NN and for 3NN which 
are sufficient to conclude about the QPTs when a in¬ 
creases, see Fig. [Q First, for a G [0,0.355) (phase I), 
the NN correlations are almost independent of 7, i.e., 
5 7 (1,2) ~ ^(l, 2)/3, and one finds a RVB phase which 
weakens above a ~ 0.3. At a cs 0.355 the first QPT 
occurs, see Figs. Oja) and QJb), and both 5(1,3) and 
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FIG. 1. Spin-spin correlations as obtained for KH model (1) 
at increasing a, with —2J5i5f interaction at a = 1 : top (a) 
— NN (SJS 2 ), and bottom (b) — 3NN (S^SJ) (this bond 
is parallel to (5|5!) at a = 1). QPTs occur at vertical lines 
and phases are labeled from I to VI. 


5(1,4) change signs, cf. Figs. 0 a) and 0b). Two non¬ 
degenerate states cross at the QPT and the derivative 
of Eq changes (Table I). As in spin-orbital systems [l5j |. 
phase II is driven here by J 2 and J 3 while Ji changes 
sign. It has FM (AF) NNN (3NN) correlations, see Fig. 
mb), and we suggest that it is a precursor of the zigzag 
phase found in this range of parameters 0,0- 


A second QPT occurs at a ~ 0.385, where two nonde¬ 
generate ground states intersect and Eq is maximal. Here 
both spin-spin correlations 5(1,2) and 5(1,4) change 
signs. Already at a = 0.355 we observe that S z (1,2) 
separates from 5*(1,2) = 5 y (l,2), and 5 y (l,4) sepa¬ 
rates from 5 X (1,4) = 5 2 (1,4), and this persists up to 
a = 1, see Figs. [TJa) and [2(b). 

Further discontinuities arise for all 5 7 (1,2) at a ~ 
0.770, but in their sum 5(1,2) they nearly cancel one 
another and the discontinuity of 5(1, 2) almost vanishes. 
At this QPT a singlet and a triplet cross. Notably, the 
correlation functions do not change signs at this QPT, 
see Figs. He) and [2](d). We observe that in phase IV 
NN FM correlations grow stronger while NNN and 3NN 
correlations (both AF) weaken. 



FIG. 2. Spin-spin correlation functions for the Hamiltonian 
0 for selected values of a (below each panel). The sign (AF 
or FM) is indicated by line color: blue — AF correlation, 
red — FM correlation; the line width is proportional to its 
absolute value. Parameters: J 2 = J 3 = 0.5Ji. 


At a ~ 0.890 the triplet state crosses with another 
singlet ground state, indicating a QPT to a distinct spin 
disordered phase V, stable for a € [0.89,1). All spin-spin 
correlations are discontinuous at the transition (Table I) 
and all NNN ones vanish, see Fig. 0e), while 5 y (l,4) is 
small and finite 0, see Fig. 0b). The gap between the 
ground state and triplet excited state first grows and then 
start to shrink with increasing a until both states merge 
at a = 1, where one finds FM spin correlations for NN 
only, see Fig. 0f). The only finite spin-spin correlation 
at a = 1 happens to be 5 2 (1, 2), see Fig. 0a). 

For a = 1 the ground state degeneracy is d = 4; it 
is lifted when minute Heisenberg interaction is added 
at a < 1, in analogy to the 2D compass model, where 
Heisenberg terms remove high degeneracy of the ground 
state [17]. In contrast, however, the ground state does 


not change and the Kitaev spin liquid survives here in the 
range of a € [0.89,1), with additional 3NN correlations. 

Special attention has to be paid to 5 y (l,4), with its 
sign being different from that of S x (l, 4) = 5 Z (1,4) when 


TABLE I. Discontinuities in spin-spin correlations 5(1, n) 
and the feature of the ground state energy Eo (if any) at five 
QPTs which occur at a c . At the first three QPTs spin cor¬ 
relations change sign (sign) between the ground states with 


degeneracies d < and d> 

. for a < 

a c 

and a > 

a c , respectively. 

Ot c 

5(1, n) 

sign 

d< 

d> 

feature of Eo 

~ 0.355 

5(1,3) 

+/- 

1 

1 

slope change 


5(1,4) 

-/+ 




~ 0.385 

5(1,2) 

-/+ 

1 

1 

maximum 


5(1,4) 

+/- 




~ 0.770 

5(1,4) 

+/- 

1 

3 

slope change 

~ 0.890 

5(1, n) 


3 

1 


1.0 

5(1,4) 

-/o 

1 

4 
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FIG. 3. Spin-spin NN correlations obtained for converged 
MF calculations for 0 < a < 1: 5(1,2), S( 2,3), 5(3,4). QPTs 
occur at vertical lines and phases are labeled from I to VI. 
Parameters: J 2 = J 3 = 0. 


a £ [0.355,1). This function has a discontinuity at each 
QPT, see Table I. It concerns the bond (14) which is 
parallel to the NN bond (23) with 5|5| interaction in the 
Kitaev limit, so we see that the Kitaev part induces 3NN 
correlations for the same component 7 which is active 
along the NN bonds parallel to it. Partial NNN spin 
correlations also separate at a = 0.355 but drop to zero 
when spins get disordered at a = 0.890. 

Previous studies within the cluster MF inspired 

us to consider the hexagon with only NN Heisenberg 
Ji and Kitaev Jk = —2Jct terms. We embedded the 
hexagon by the MF terms, replacing spins along outer 
NN bonds with the order parameters, s? = (S'?). They 
were selected using either Neel or stripe ansatz and cal¬ 
culated self-consistently. For a £ (0,0.39] (phase II) the 
SU(2) symmetry is broken and (sf} and {S(i, j)} follow 
Neel AF order (phase I) which extends up to a = 0.395 
due to quantum fluctuations, see Fig. [3j Near the QPT 
at a = 0.390 one finds robust Neel order with posi¬ 
tive/negative values of |s?| ~ 0.4172 at odd/even site 
i of the hexagon. 

For a < 0.36 the stripy ansatz gave s? = 0, while 
spin-spin correlations are constant and RVB-likc. At 
a = 0.365 the symmetry is broken (s? ^ 0), but the NN 
correlations do not follow the stripy pattern yet. We ob¬ 
tained the stripy phase for a £ [0.395,0.55] (phase III), 
with FM (AF) spin-spin correlations 5(1,2) = 5(4,5) 
(otherwise), see Fig. [3] Unlike in Neel phase, here one 
finds two distinct values of the order parameters {|s?|}, 
e.g. sf ~ 0.3795 (-0.2675) for i = 1,2,4,5 (i = 3,6) 
at a = 0.395, as the sites are nonequivalent and the 
latter ones are exposed to enhanced quantum fluctua¬ 
tions within the hexagon. These fluctuations disappear 
at a = 0.5, in agreement with the mapping on the FM 


Heisenberg model Q. Unfortunately, we could not ob¬ 
tain converged results for a £ [0.5,0.525). The region 
of (stripe) phase III agrees partly with that obtained for 
a larger cluster of N = 24 sites, a £ [0.4, 0.8] 0. We 
thus conclude that the stripy order is subtle and hard to 
stabilize on a single hexagon. 

For a £ (0.555,0.98) (phase IV) the symmetry remains 
broken but the stripe phase is destroyed here by Kitaev 
terms and all NN S(i,j) are weakly FM and anisotropic, 
see Fig. [3] At a = 0.98 one finds a QPT to disordered 
spin liquid with d = 3 (phase V). It is similar to phase IV 
of a free hexagon (see Tabic I). The last QPT is found at 
the Kitaev limit a = 1 itself, where we find again d = 4. 

Summarizing, we conclude that increasing Kitaev in¬ 
teractions cause spin-spin correlations 575j to separate. 
This phenomenon is generic and occurs both for a free 
hexagon and in MF shortly after one NN interaction 
5757 changes sign. Unless Kitaev terms dominate, inves¬ 
tigation of possible long-range order requires cluster MF 
or even more sophisticated methods. The Kitaev spin 
liquid phase extends to a < 1 also in the MF approach, 
but 3NN spin correlations are induced in this regime. 
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